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© Performance data processing system. 


© For processing data relating to the performance 
of an apparatus, analysis of measurement data is 
performed using the Kalman Filter. The results of a 
first -pass of the data through the filter are refined by 
discarding at least one less significant component 
change and/or sensor bias and the Kalman Filter is 
re-run using the thus modified data. Further runs of 
the Kalman Filter are performed, as required, in each 
the input being refined by discarding from the pre- 
ceding run at least one further value. For each run 
an objective function is evaluated for the amount of 


unexplained measurement change and/or the 
amount of component change and sensor bias and 
the run whose results show an acceptable value for 
the objective function is selected as the best solu- 
tion. In this way, the tendency of the Kalman Filter to 
distribute the cause of any sensed performance 
change over all the possible sources of that change 
is avoided. The invention also includes a method of 
analysing a number of sets of measurement data to 
determine levels and/or trends in component perfor- 
mance and sensor bias. 
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Description 

BACKGROUND OF THE INVENTION 

5 The invention relates to a method and system for processing data relating to the performance of 
apparatus having a number of distinct components in order to estimate both changes in the performance of 
the individual components making up the apparatus and biasses or systematic errors in a measurement 
system being used to determine the performance of the apparatus and its components. It has particular 
relevance to analysing the performance of gas turbines, although it has more general applications to a wide 

70 variety of apparatus including machines, particularly prime movers and other rotary machines, and plant, 
such as chemical process plant, generating and distribution plant, etc. 

Monitoring the performance of such machines and plant can yield important data on maintenance 
requirements to achieve safe, economical and reliable operation. It is particularly important in such 
circumstances to determine both which components of the machine or plant being monitored have deviated 

75 from their required performance specifications and which measurements being used for monitoring have 
developed systematic errors, in order to refurbish or replace only those components which have deterio- 
rated and refurbish, replace or recalibrate faulty measuring equipment that, because of the presence of 
systematic errors, is producing spurious indications. 

It is important to note that the overall performance of any apparatus made up of a number of 

20 components is completely determined by the performance of such components. For example, in a gas 
turbine, overall performance measurements such as fuel consumption, speed, exhaust temperature, etc. are 
determined by component performance parameters such as efficiency, flow capacity, etc. Generally, 
changes in one or more component performance parameters will cause changes in one or more overall 
performance measurements, and it is only possible to alter overall performance measurements by altering 

25 one or more component performance parameters. Thus, it is only possible to improve the fuel consumption 
of a gas turbine by altering the efficiency and/or flow capacity of one or more of its components. Naturally, 
some apparent changes in overall performance may be caused, not by component performance changes, 
but by biasses in the measurements used to determine the overall performance. The problem exists, 
therefore, to be able to assess, from an analysis of changes in performance measurements, both the 

30 component performance parameters that have changed and the biasses in the measurements. 

To assist the engineer in this task, recent years have seen the introduction of computer-based 
performance data analysis systems, particularly in the field of gas turbines. From the preceding comments 
it can be appreciated that any analysis has to be performed using a number of known data items (i.e. 
performance measurements) which is generally less than the number of unknown data items (i.e. compo- 

35 nent performance parameter changes and sensor biasses). There is therefore no single true solution set of 
component performance parameter changes and sensor biasses to be derived from a particular set of 
performance measurement data, and techniques are required that derive the most likely solution. In 
particular, so-called Optimal Estimation or Kalman Filtering computation techniques have been used to 
analyse gas turbine performance data (see, for example, "Gas Path Analysis applied to Turbine Engine 

40 Condition Monitoring", LA Urban, AIAA 72-1082 (1973) and "Gas Path Analysis: An Approach to Engine 
Diagnostics", Dr A.J.Volponi, 35th Mechanical Failures Prevention Group (1982)). The basic theory behind 
Kalman Filtering is also well known (see, for example, "Digital and Kalman Filtering", S.M. Bozic, Pub E 
Arnold (1984); "Applied Optimal Estimation", A Gelb (ed), Pub MIT Press (1974); "Applied Optimal 
Control", A.E.Bryson and Y.C.Ho, Pub Halstead Press (1975); "System Identification", P.Eykhoff, Pub Wiley 

45 (1974)). 

The Kalman Filter is an algorithm for producing, from given data, the most likely solution, based on the 
method of least squares. Stated in its simplest form it may be seen as a weighting matrix (sometimes 
termed the Kalman Gain Matrix) which inter-relates a-priori information (specifically a covariance matrix of 
component changes and sensor biasses, a measurement repeatability covariance matrix and a System 

so Matrix, ie a matrix giving the relationships between observed measurement changes and component 
changes and sensor biasses) to enable the most likely set of component changes and sensor biasses to be 
calculated from the observed performance measurement changes. 

The Kalman Filter algorithm is thus given a set of observed performance measurement changes. Each 
of these changes represents the change in value of a parameter from a datum level (at which there are no 

55 component changes or sensor biasses to be taken into account) to an operational level (which has been 
affected by such changes and biasses). The algorithm calculates which set of component performance 
changes and sensor biasses is most likely to have caused the given set of observed performance 
measurement changes, using information described in the preceding paragraph. 
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An inherent shortcoming of the Kalman Filter is that, because it operates on the basis of least squares, 
it tends to allocate a value to all possible component changes and sensor biasses, even if the observed 
performance measurement changes input to the filter are due to only a small sub-set of the possible 
component changes and sensor biasses. The effects of any genuine component performance changes 
5 and/or sensor biasses therefore tend to be "smeared" over all possible component changes and sensor 
biasses, leading to under-estimation of actual component changes and/or sensor biasses which may have 
occurred in any particular situation. 

In the extensive literature describing the use of the Kalman Filter for the analysis of apparatus 
(particularly gas turbines), this problem is either ignored or is addressed in one of four different ways, 
w namely: 

a) the problem is alleviated, but not eliminated, by adjustment of the a-priori matrices used to calculate 
the Kalman Gain Matrix, 

b) other algorithms are run after the Kalman Filter which assume the presence of a single component 
change or sensor bias; these algorithms are activated if the results from the Kalman Filter exceed certain 

75 thresholds, 

c) searches are made for sensor biases using separate algorithms run before and/or after the Kalman 
filter, 

d) "banks" of Kalman filters are set up to analyse a given piece of apparatus: each filter in such a bank 
is set up to analyse a different combination of component changes and sensor biases, while other 

20 algorithms are used to decide which filter is correct in any given situation. 

Patent no. US-A-4215412 (Bernier et al.) provides an instance of the use of Kalman filtering in 
performance monitoring, in which the above problem seems to be ignored. The patent is concerned with 
digital processing of sensor data to make predictions of values of gas turbine engine performance 
parameters which are indicative of performance deterioration. Values of actual and predicted performance 

25 parameters are compared to derive deviation signals which are supplied to monitoring logic. The monitoring 
logic uses the deviation signals to indicate faults within the digital processor, the sensors and the engine 
and to determine trends in the performance parameters. Specifically, Kalman filtering is used to determine 
the values of certain performance related coefficients distinctive of the particular gas turbine engine whose 
performance is being monitored. It is also used to derive performance trend coefficients whose current 

30 values reflect long-term changes in the monitored performance parameters. 

On the other hand, Patent Abstract of Japan Band 9, No.6 (P-326) 11.1.85 appears to provide an 
example of strategy (b), described above, whereas Patent Abstract of Japan Band 8, No.269 (P-319) 8.12.84 
seems to be an example of the above strategy (c). 

The above approaches are unsatisfactory because they either work within the restrictions of the Kalman 

35 filter without solving the basic "smearing" tendency, or rely on gross assumptions about the number and/or 
combinations and/or magnitudes of component changes and/or sensor biases, which may not always be 
correct. 

SUMMARY OF THE INVENTION 

40 

The invention provides a method for processing data relating to the performance of an apparatus, the 
apparatus including a plurality of components whose individual performances affect the performance of the 
apparatus and a plurality of sensors for giving inputs to a performance measurement system, the inputs 
from the sensors being subject to biases which produce errors in the measured performance of the 
45 apparatus, the method involving determination of changes in component performance and magnitude of 
sensor biases from a series of performance measurements, the method comprising the steps of: 

a) defining a-priori information required by a Kalman filter, comprising 

i) a covariance matrix of component performance measurement changes and sensor biases, 

ii) a measurement non-repeatability covariance matrix, 

50 iii) a system matrix which provides relationships between observed performance measurement 

changes and sensor biases; 

b) using the performance measurement system to obtain datum levels of the performance measurements 
from the apparatus; 

c) using the performance measurement system to obtain performance measurements from the appara- 
55 tus; 

d) using data obtained in steps (b) and (c) to derive performance measurement differences from datum 
levels; 


3 


EP 0 315 307 B1 


e) using data obtained in steps (a) and (d) to derive a most likely set of component performance changes 
and sensor biases by employing a Kalman filter; the method being characterised by the further steps of 

f) evaluating an objective function giving a measure of the amount of unexplained performance 
measurement change and/or the amounts of component performance measurement change and sensor 

5 bias in the solution from (e), 

g) discarding one or more of the component performance changes and/or sensor biases, to leave one or 
more of said component changes and/or sensor biases for evaluation; 

h) repeating steps (e) to (g). if required, until the total number of component performance changes and 
sensor biases remaining is one; and 

10 i) considering sets of estimated component performance changes and sensor biases produced in each 
repeat of step (e), together with the corresponding objective function evaluated according to step (f), to 
identify as a best result that repeat of step (e) which has produced a minimum number of component 
performance changes and sensor biases that satisfactorily account for the calculated performance 
measurement differences. 

75 In the performance of the method for processing data, the reiteration of steps (e) to (g) produces a 
sequence of vectors of component performance changes and sensor biases which account for the observed 
performance measurement differences, each successive vector containing progressively reducing numbers 
of component performance changes and sensor biases. The selection of an appropriate result is made by 
using the objective function, worked out for each vector in step (f) above. One method of working out such 

20 an objective function is to derive the sum of squares of the unexplained measurement changes, weighted 
according to the measurement repeatability covariance matrix. This gives a value which has a chi-square 
distribution, with as many degrees of freedom as there are performance measurements to be analysed. 

In the the final result from step (i), above, the selected best answer is preferably refined by discarding 
those elements whose values (expressed e.g. either in absolute terms or as a number of standard 

25 deviations) are less than a predetermined lower level, in order to eliminate minor component changes and 
sensor biasses that can be safely ignored or that may be present in the answer as a residual "smearing" 
effect. 

As a preferred basis for the rejection process in step (g), the estimated component changes and sensor 
biasses can be normalised by dividing the individual estimated component changes and sensor biasses by 

30 the square roots of the corresponding diagonal elements of the a-posteriori covariance matrix produced as 
output from the Kalman Filter. 

To select the elements to be discarded in step (h), a preferred method on the first pass is to evaluate 
the average amount of absolute normalized change (i.e. with sign removed) and then discard all elements 
whose absolute normalized change is below that average. For subsequent passes, all component changes 

35 and/or sensor biasses whose absolute values of normalized change are less than the previous pass are 
discarded; however, in each pass provision must be made to reject at least one component change or bias 
(usually the one having the smallest absolute value of normalized change) and to retain at least one 
component change or sensor bias (usually the one having the largest absolute value of normalized change). 
When establishing the System Matrix, the effects of changes in the components of the apparatus under 

40 investigation on the measurements used to determine the performance of the apparatus and its components 
must be determined. Care should be exercised to ensure that suitable measurements are taken that 
respond in distinct ways to the component changes being sought. 


GAS TURBINE ANALYSIS 

In the example of a gas turbine analysis, the component changes may involve changes in seal 
clearances, the presence of foreign matter in particular locations, the opening of gas leakage paths, etc. 
These can each be related to one or more component performance parameter changes. A list of these 
related changes can be drawn up, as in the following example. 


55 
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Component Changes 
turbine tip seal rubs 

5 

nozzle guide vane platform seal 
7 o gaps; blocked nozzle guide vane 
cooling holes 

75 

compressor blade tip erosion; 
dirt on compressor blades; 
20 damage by foreign object 


Performance Parameter Changes 
turbine efficiency changes 

turbine capacity changes; 
cooling air changes 

compressor efficiency changes 


mis-shapen final nozzle 

25 


seal gap increases 


air offtake pipe leaks 


nozzle discharge and velocity 
coefficient changes 

cooling air changes 

environmental control system 
bleed changes 


40 The causes of a change in engine performance can accordingly be expressed as a series of component 

performance parameter changes. Thus, for example: 

fan tip efficiency and capacity changes 

fan root/booster efficiency and capacity changes 

core compressor efficiency and capacity changes 
45 turbine efficiency and capacity changes 

combustion chamber pressure loss changes 

by-pass duct pressure loss changes 

nozzle discharge and velocity coefficient changes 

cooling/sealing air flow changes 
50 environmental control system bleed and power offtake changes 

These changes will each affect overall engine performance parameters such as cruise specific fuel 

consumption, take-off turbine exhaust temperature, compressor working line levels, etc. The purpose of the 

performance measurements made is to enable resolution of the causes of such overall performance 

parameter changes, by identification of the individual component performance parameter changes that 
55 caused them. 

Few if any of the component performance parameter changes can be directly measured in practice. 
Moreover, the measurement instrumentation available in a production engine will be extremely limited as 
compared with a fully instrumented engine in a test rig. The typical performance measurements that may 
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be available are: 
shaft speeds 
fuel flow 
(test-bed) thrust 

5 total inlet air flow (itself derived from total and static pressure measurements and total temperature) 

total and/or static pressures in the engine gas path - through either single or multiple taps in that 

path 

total and/or "static" temperatures in the engine gas path (the former through single or multiple taps and 
the latter through wall-mounted transducers) 

w a power level parameter, e.g. exhaust pressure ratio or output shaft torque. 

After establishing the list of possible component performance parameter changes and the list of available 
performance measurements, a component exchange rate table is generated showing the percentage 
change in each performance measurement for a small change of each component performance parameter 
(e.g, a 1% change, or a unit change if the datum value is zero) at the operational conditions, i.e. the flight 

75 conditions and power level, at which the analysis is to be performed. 

FURTHER GENERAL FACTORS IN THE ANALYSIS PROCESS 

Also to be considered in the analysis of the performance of apparatus such as a gas turbine are 

20 environmental parameters, since environmental changes can alter the engine performance. Measurements 
are therefore required defining the environmental conditions. Depending upon whether the analysis is being 
performed in flight or on a test-bed these should include altitude, Mach No, total air temperature (flight), cell 
pressure and air intake temperature (test-bed), and preferably appropriate measurements for humidity 
determination. With these there must always be one performance measurement from the preceding table 

25 before any form of analysis can begin: this measurement is used to define the power level. 

It will normally also be required to include the effects of environmental and power level measurement 
sensor bias in the analysis, for which it is necessary to calculate the effects of small (e.g., 1%) biasses in 
flight conditions and power-setting parameter measurements, these having been assumed fixed when 
establishing the component exchange rate table. This is done by calculating the percentage changes in the 

30 performance measurements if the flight condition and power level measurements are changed by a 
negative increment, to create the environmental exchange rate table. (The choice of the negative sign is 
because a positive bias, i.e., a higher reading than the actual value, will produce apparently depressed 
performance measurements). 

The effects of performance measurement sensor bias on the analysis can be included by generating a 

35 further matrix. This can be formulated essentially as a matrix which states that a sensor bias (e.g., 1%) in a 
performance measurement produces a corresponding change in that measurement while leaving all the 
other measurements unaffected. If sensor bias is considered possible in all the measurements, this matrix is 
an identify matrix. 

A combined matrix, which is here termed the System Matrix, can then be created by concatenating the 
40 component exchange rate table, the environmental exchange rate table and the performance measurement 
sensor bias matrix. 

A further factor which it is usually necessary to consider is the random error that exists in all 
measurement systems. That is to say, the degree of accuracy of any measurement is not represented 
solely by sensor biasses; there will also be uncertainty due to random variations caused by many small 

45 effects which lead to differences in repeated measurements of a given quantity. This error source is 
referred to here as repeatability. Random variations will also occur in the environmental and power level 
measurements, introducing further repeatability factors. It can be assumed, if bias is accounted for 
separately, that these random variations will have the well-known normal distribution. To take account of 
repeatability, it is therefore necessary to determine standard deviations for the repeatabilities of the 

50 environmental and power level measurements. The analysis must give due weight to the repeatability of all 
the measurements. 

The measurement repeatability standard deviations can be determined either by dedicated testing of 
the measurement system, in which the statistical properties of the measurement system are calculated from 
the output generated by known input signals, or from previous experience of either the system being used 
55 or of similar systems in use elsewhere. 

The standard deviations of component change and sensor bias can be determined by a variety of 
methods, for example by the analysis of data taken from a large "family" of nominally identical pieces of 
apparatus of the type being analysed, or by making an informed assessment using experience and 
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judgement, perhaps refined by studying the response of the Kalman Filter to performance measurement 
changes corresponding to known component changes and sensor biasses. 

DETAILED DESCRIPTION OF AN ANALYTICAL PROCESS 

5 

To establish the Kalman Filter, the following input is required: 

a) component exchange rate and environmental exchange rate tables, as discussed above, which are 
used to produce the System Matrix; these tables contain the established relationships between compo- 
nent changes and performance measurements and the changes in performance measurements due to 

70 environmental and power level measurement errors, 

b) a set of expected levels of performance measurements at the flight conditions and power level at 
which the analysis is to be performed for a datum engine - i.e. an engine with performance at some 
desired level with which other engines can be compared; since the best estimates of component 
changes and sensor biasses produced by the Kalman Filter will be relative to this datum, it follows that 

75 the datum engine component changes and sensor biasses are all zero: in the performance analysis, 
percentage differences between observed and expected levels of performance measurements will be 
input into the Kalman Filter to produce the desired best estimates of component changes and sensor 
biasses that produced those differences, 

c) a set of standard deviations of the repeatability in the performance measurements, flight condition 
20 measurements and power level measurements from which the a-priori measurement non-repeatability 

covariance matrix is calculated, 

d) a set of standard deviations in the component changes and sensor biasses about their normal (usually 
zero) levels: these are used to create the a-priori component change and sensor bias covariance matrix, 
usually (but not necessarily limited to) a diagonal matrix containing the squares of these standard 

25 deviations. 

Considering the concept of the Kalman Filter, the basic equation defining the analysis being undertaken 
and which forms a starting point for the Kalman Filter is 

y = C * x + y 

30 

in which: 

y = (m * 1) column vector of differences between observed and expected levels of performance 
measurements 

C = (m * n) System Matrix, as described above, defining the effect on the performance measurements 
35 of given changes in component performance parameters, environmental and power level measurement 
sensor biasses and performance measurement sensor biasses 

x = (n * 1) column vector of changes in component performance parameters and sensor biasses 
v = (m * 1) column vector of noise terms in the performance measurement differences - assumed to be 
normally distributed, with a mean zero and a known covariance R. 
40 It can be seen that the equation states the relationship between the performance measurement 
differences from expectation and the component changes and sensor biasses that generated them. The 
noise terms represent a degree of corruption of the performance measurement differences due to random 
errors in the measurement system. 

As has already been explained, since the number of terms (n) in x is usually considerably greater than 
45 the number of terms (m) in y, there is no unique solution that identifies which term or terms in x has 
generated a change in y. All that is possible by mathematical analysis is a "best estimate", i.e. a solution 
expressed as the most likely vector of component changes and sensor biasses that has generated an 
observed vector of performance measurement differences. Through the algorithm known as the Kalman 
Filter that estimate can be generated. 
50 The Kalman Filter can be expressed in the following group of equations: 

x = x 0 + K * (y -C * x D ) 
K = Q . C T * (C * Q * C T + R)" 1 
= (I - K * C) * Q 

55 

where 

x = (n * 1) column vector of best estimates of component changes and sensor biasses after 

performance measurement differences from expectation are observed 
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x 0 = (n * 1) column vector of best estimates of component changes and sensor biasses before 
performance measurement differences from expectation are observed. This vector is usually 
zero; in this case x = K * y 

y = (m - 1) column vector of performance measurement differences from expectation 

K = (n - m) Kalman Gain Matrix 

C = (m * n) System Matrix, relating performance measurement differences to component changes 
and sensor biasses 

Q = (n * n) a-priori covariance matrix of component changes and sensor biasses 
Pt = (n * n) a-posteriori covariance matrix of best estimates of component changes and sensor 
biasses 

Superscript T denotes matrix transpose 
Superscript -1 denotes matrix inversion 
I denotes unit matrix of appropriate dimensions 

R = (m * m) a-priori measurement repeatability covariance matrix, 
which can be established in the form 

R = C' * V * C' T 

in which 

V = (t * t) diagonal matrix of squares of standard deviations of repeatabilities, where t = number of 
environmental measurements plus number of performance measurements 

C = (m * t) matrix which contains both the environmental exchange rate table and a unit matrix 
concatenated together 

The R matrix therefore contains the variances and covariances of the apparent repeatability in the 
performance measurement differences, arising from both repeatability in the observed performance mea- 
surements and the repeatability in the expected performance measurements that is a consequence of 
repeatability in the flight condition and power-level measurements that define the levels of expected 
performance measurements. 

For a detailed derivation of the Kalman Filter equations, reference can be made to "Applied Optimal 
Estimation", A Gelb, M.l.T. Press 1974. The equations denote that K is proportional to the uncertainty in the 
estimation x and is inversely proportional to the uncertainty in the measurements y; K weights the changes 
made to x Q to produce x depending upon the relative certainty of y and x. 

The use of prior information about expected levels of component changes and sensor biasses, 
uncertainties in both the expected levels of component changes and sensor biasses and uncertainties in the 
measurements relies upon the judgement of the skilled observer. That is to say, if there is no uncertainty 
about the mathematical relation between variables but considerations of repeatability indicate a large 
uncertainty in the measurements, the best estimate of the relationship will not be affected by measurements 
that do not conform to the established mathematical relationship. On the other hand if the relationship is 
uncertain and measurement repeatability is considered to be give negligible uncertainty, the best estimate 
of the relationship will be determined to a large extent by the measurements. 

Generally, there is insufficient data available in the first instance for an adequate statistical analysis of 
these factors. From practical considerations, therefore, the values in the Q matrix are at least initially 
selected by the judgement of the user. To obtain a measure of how appropriate are the values chosen, in 
an initial processing of the input data it is possible to produce (by forming the product K * C) the set of 
vectors of best estimates of component performance changes and sensor biasses for performance 
measurement differences appropriate to a unit change of each component change or sensor bias in turn 
and to examine the results to see whether, for a specific change in the performance of a component or the 
bias of a sensor, there is an unwanted confusion of the sought-for change or bias with the other changes 
and biasses included. Should this be observed, the Q matrix can be modified to reduce the possible 
confusion to a minimum. 

In an ideal case, the product (K * C) would be a unit matrix; confusion between the different parameters 
gives the diagonals of the matrix values less than unity, as well as non-zero off-diagonal elements. A 
preferred method of refining the Q matrix relies on first normalising the (K * C) matrix by dividing each row 
by the corresponding diagonal element of the Pi matrix. In the normalised matrix, the values in each 
column are then divided by the diagonal element of that column so as to produce a matrix in which all the 
diagonal elements are unity; this last step is performed primarily to aid recognition of the relative sizes of 
these diagonal elements to the other values of their column vector. 
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In making the comparison, the user will want to ensure that no ratio should be greater than unity, and 
that the number of ratios greater than 0.6, other than the diagonal element itself, should be minimised. The 
aim is that, for any column, the number of ratios greater than the average of the absolute values of all the 
ratios should be minimised. One way of doing this is to use an algorithm such as the Downhill Simplex 
5 Method (Nelder and Mead page 308, Computer Journal, Vol 7, 1965) to adjust the component change and 
sensor bias standard deviations, (i.e the square root of the diagonal elements of the Q matrix) until the sum 
of the absolute values of the off-diagonal terms in the normalised (K * C) matrix is minimised, giving extra 
weightings if necessary to elements with absolute values greater than 0.6 and elements with absolute values 
greater than 1.0. 

10 If the analysis is carried out with no further refinement, however, the underlying mathematical principles, 
as already mentioned, result in all the component changes and sensor biasses being analysed as non-zero 
and give a result in which the observed performance measurement changes are attributed to all the 
possible component changes and sensor biasses that might have caused them. This introduces a 
"smearing" effect which can result in the actual component changes and sensor biasses being underes- 

75 timated. In accordance with the present invention, the result is treated so as to concentrate the estimates 
around the more significant component changes and sensor biasses that appear through the basic Kalman 
Filter analysis. This involves selectively removing individual changes and biasses while re-distributing any 
observed effects over the remaining changes and biasses until the analysis yields a result which appears 
more appropriate to the observer, for example showing that the observed performance changes can be 

20 attributed wholly or mainly to a small number of significant component changes and/or sensor baisses. 

A preferred method of carrying out this process for concentrating the attribution of the changes involves 
the following steps: 

(a) evaluate an objective function f; 

25 f = (y - C * x) T * R -1 *(y - C*x) 

(this gives a measure of the amount of unexplained measurement change and has a chi-square 
distribution, with the number of degrees of freedom equal to the number of performance measurements), 

(b) normalise each element of the vector x by dividing by the square root of the respective diagonal 
30 element of the Pi matrix to produce vector x n with elements given by: 

i'th element of 

£ i'th element of £ 

= /"(i'th diagonal element of P7J 

35 1 

(c) component changes and sensor biasses whose elements in x n have absolute values less than the 
average of all the absolute values of the elements in x n are removed (at least one, but not all, of the 
component changes and sensor biasses are removed in this step), 

40 (d) the Kalman Filter is re-run, including only those component changes and sensor biasses that have 
not been removed in step (c), to produce a new vector x of best estimates of component changes and 
sensor biasses, 

(e) steps (a),(b) and (d) are repeated; in each repeat those component changes and sensor biasses 
whose elements in x n which have absolute values that are lower than in the preceding run are removed, 
45 (f) the repeats of steps (a),(b) and (d) are continued until only one component change or sensor bias is 
left and the series of vectors of best estimates of component changes and sensor biasses (each with a 
different number of changes and biasses) produced by each run of the Kalman Filter are numbered 
sequentially in the order in which they were generated, 

(g) a maximum is selected for the objective function value, either empirically or by calculation from a chi- 
50 square probability distribution, the number of degrees of freedom (which is equal to the number of 

performance measurements) and a user-defined probability level: the highest-numbered x vector from 
step (f) whose corresponding objective' function value is less than this maximum is selected as the "best 
answer", i.e. the selected result contains the smallest set of component changes and/or sensor biasses 
that successfully accounts for the observed performance measurement differences (if none of the 
55 objective function values are less than the maximum, the basic Kalman Filter result from the first run is 
taken as the "best answer"), 

(h) the "best answer" is further modified by rejecting component changes and sensor biasses whose 
elements in x have absolute values less than either a user-specified absolute value or a user-specified 
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absolute number of standard deviations: the user is therefore presented with the most significant set of 
estimated component changes and sensor biasses that generated the observed performance measure- 
ment differences. 

5 FURTHER DEVELOPMENTS OF THE METHOD 

The method described so far is one in which an analysis yields information based on a set of 
performance measurement differences obtained at a particular point in time. In certain situations, where the 
apparatus is being monitored over a period of time, it is possible to obtain a number of sets of performance 
measurement differences gathered sequentially over time. Each distinct type of performance measurement 
difference, gathered over time, can be considered as a time series in its own right, and can be processed 
using a number of well known prior art techniques, for example: 

a) moving average 

b) exponential smoothing 

c) Bayesian Inferencing 

Bayesian Inferencing is the preferred method of processing time series data, since an observed time 
series can be processed to produce: 

a) level estimates, i.e. estimates of the value of a parameter in which, as far as possible, spurious 
disturbances from point to point have been removed, 

b) trend estimates, i.e. estimates of the rate of change of the parameter in question, 

c) differences between the observed value of the parameter in question and the value that would be 
predicted from the level and trend estimates associated with the previous point in the time series. 

Full details of this method are given in "Bayesian Forecasting", P J Harrison and C F Stevens, J Royal 
Statistical Soc, 1976 and "A Bayesian Approach to Short-Term Forecasting", P J Harrison and C F 
Stevens, Operational Research Quarterly, Vol 2 No 4 1971. The equations used are as follows: 

si = (Pn lk -i/r + qn/r) + 2*(p 12(k - 1 /r + qi 2 /r) + (p 2 2,k-i/r + q22/r) 
s 2 = (Pi2,k-i/r + Qi2/r) + (p 22 ,k-i/r + q2 2 /r) 
s 3 = (p 22t k-i/r + q22/r) 
Delta k = Obs k - (Level k -i + Trendy) 
Level k = (Levelk-! + Trend k _i) + (Si/(si + 1))*Delta k 
Trend k = Trends + (s 2 /(si + 1))*Delta k 
Pn,k/r = si/(si + 1) 
P 12ik /r = s 2 /(si + 1) 

P22,k /r = s 3 " s 2 /(s l + 0 

40 where 

qn/r, qi 2 /r, q22/r are the level variance, the level-trend covariance and the trend variance, each divided 
by the variance of the repeatability of the observations. 

pn/r, pi 2 /r, p22/r are the level estimate variance, the level-trend estimate covariance and the trend 
estimate variance, each divided by the repeatability of the observations. 
45 Obs = observed value of parameter 

Delta = difference between observed value of parameter and value predicted from previous level and 
trend estimates 

Level = Level estimate 

Trend = Trend estimate 
50 si , s 2 , s 3 are defined by the above equations, and used to simplify the algebra 

subscript k denotes current point in time series 

subscript k-1 denotes previous point in time series 

All the available performance measurement differences, gathered over time, can be processed, using 
the above algorithm (or one of the other prior art techniques) to produce sets of measurement difference 
55 level estimates, trend estimates and differences between observed and predicted values ( or output 
appropriate to the other prior art techniques) corresponding to each observed set of performance measure- 
ment differences. The other prior art techniques can similarly be operated on time series data to produce 
results in accordance with their known capabilities. In the case of Bayesian Inferencing, each set of 
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measurement difference level estimates produced can be used as input in the method according to the 
invention to give estimates of component changes and/or sensor biasses that are unaffected, as far as 
possible, by spurious disturbances in the performance measurement differences. Furthermore, each set of 
measurement difference trend estimates can be used as input in the method according to the invention to 
5 give estimates of the rate of change of component changes and/or biasses, and each set of differences 
between observed and predicted measurement difference can be used as input in the method to detect 
sudden changes in the component changes and/or sensor biasses from one point to the next. If other prior 
art algorithms are used, the sets of output produced can, in a similar manner, be input to the method 
according to the invention to produce corresponding component change and/or sensor bias assessments. 

70 

EXAMPLES OF THE ANALYTICAL METHODS OF THE INVENTION 

In the further description of the invention, reference will be made to the accompanying drawings, in 
which: 

75 Fig. 1 is a schematic illustration of the analytical situation to which the invention is applied, 
Fig. 2 illustrates the System Matrix of Fig. 1, 

Fig. 3 is a diagrammatic sectional view of a single-spool gas turbine indicating the performance 
measurement sources used for an analysis of its performance by the method of the invention, and 
Fig. 4 is a flow diagram illustrating the application of the method of the invention to estimate levels and 
20 trends. 

Fig. 1 illustrates schematically the manner in which the vector x of unknown component changes and 
unknown sensor biasses produces an observed vector y of observed differences in the performance 
measurements. The changes are imposed on the apparatus, i.e. in the example under discussion this being 
the gas turbine shown in Fig. 3, and in that apparatus, the interdependence of the variables of the system 

25 give rise to performance measurement differences, the observation of which may be corrupted to some 
extent by noise or random variations (v). The relationships between component changes and sensor biasses 
and observed performance measurement changes are defined by the System Matrix C shown in Fig. 2. 
This consists of an (m * j) component exchange rate table which sets out the effects of small changes in a 
series of j component performance parameters on a series of m performance measurements at specific 

30 environmental conditions and a specific power level, an environmental exchange rate table in the form of an 
(m * k) exchange rate table setting out the effects on the m performance measurements of small changes in 
the (k-1) environmental conditions and power level, and finally a table for sensor bias, stating that a specific 
bias in a performance measurement produces a corresponding change in that measurement while leaving 
all other measurements unaffected. 

35 Fig. 3 shows a single-shaft gas turbine jet engine with a compressor section 100 immediately 
downstream of an air inlet 102 and coupled by a rotary shaft 104 to a turbine section 106 that follows a 
combustor section 108. Air is drawn through the inlet 102 into the compressor section, the compressed air 
is burnt with fuel injected into the combustor section and the hot combustion gases flow through the turbine 
section to drive the shaft 104 before exiting as a jet through an exhaust nozzle 110. The figure indicates the 

40 measurements taken during operation, in this case being those available from normal test bed instrumenta- 
tion. They consist of the inlet air flow rate (W1A), inlet total pressure (P2) and total temperature (T2), shaft 
speed (NH), compressor exit total pressure (P3) and total temperature (T3), fuel flow rate (WFE), turbine 
exit total temperature (T7) and net engine thrust (FN), this last providing a power level parameter. 

The component exchange rate table, giving the percentage change in each of these measurements for 

45 a 1% change of component performance parameter is shown in Table 1. The component performance 
parameters here are compressor efficiency (DE25) and capacity (CW25), turbine efficiency (DE4) and 
capacity (CW4), and propelling nozzle area change (A8). 

Table 2 gives the environmental exchange rate table showing the percentage change in each of the 
measurements for a 1% bias in the thrust sensor measurement (FNS), the inlet pressure sensor measure- 
so ment (P2S) and the inlet temperature sensor measurement (T2S). 

These first two tables are concatenated with a matrix showing the effects of peformance measurement 
sensor bias to give the System Matrix shown in Table 3. The matrix of measurement biasses indicates that 
a 1% sensor bias for any measurement produces a corresponding change in that measurement but no 
others. In this example, a small simplification is obtained by assuming that there can be no bias in the shaft 

55 speed measurement. 

From experience and judgement of the equipment being used, standard deviations of the repeatability 
of the measurements from the instrumentation are produced, as shown in Table 4. From these values can 
be generated the a-priori measurement repeatability covariance matrix R shown in Table 5. The matrix is 
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symmetric and is thus defined by the lower triangular elements that have been set out. 

In Table 6 are listed standard deviations of the component performance parameters and sensor biasses 
respectively which, when squared, provide a diagonal a-priori covariance matrix Q of component changes 
and sensor biasses. 

5 From the data of the preceding tables the Kalman Gain Matrix K can be obtained, as shown in Table 7, 
for use in a first pass. This data also provides an a-posteriori covariance matrix (Pi ) of best estimates of 
component changes and sensor biasses in accordance with the assumptions of Tables 1 to 6. The test 
measurements provide a vector (y) which can then be processed with this data in accordance with the 
formulae given earlier for a first pass of the Kalman Filter. In subsequent passes a similar procedure is 

w followed, using as a modified imput the progressively smaller number of component changes and sensor 
biasses remaining as one or more are discarded after each pass. 

To illustrate the operation of the concentration process, a simulated example will be described based on 
the engine of Fig. 3 and the data of the preceding tables, in which the analysis of a specific set of 
component performance parameter changes and sensor biasses is considered by using, as input, the 

75 performance measurement differences generated by those changes and biasses. Thus, Table 8 shows, for 
the engine, the performance measurement differences generated by a -1% change of compressor 
efficiency, a -0.5% bias in the engine thrust sensor (thrust being used as the power level parameter) and a 
+ 0.5% bias in the turbine exit temperature sensor. If these measurement changes are subjected to analysis 
by the Kalman Filter, the results obtained are as shown in Table 9. 

20 This first analysis is then subjected to the concentration process. Tables 10 and 11 give the calculations 
over a total of six runs of the Kalman Filter. Column 1 of Table 10 shows the results of the first run 
corresponding to Table 9 and Column 1 of Table 11 shows the square roots of the diagonals of the a- 
posteriori covariance matrix Pi associated with the respective component changes and sensor biasses. The 
absolute values of normalised elements of this vector of component changes and sensor biasses are 

25 determined and values less than the average are removed (see Table 12) and in the second column of 
Table 10 is shown the second run of the Kalman Filter in which these removed elements are assumed to be 
zero. 

The elements in column 2 of Tables 10 and 11, obtained following this second run of the Kalman Filter, 
indicate that one element, the engine inlet airflow sensor bias, can be eliminated for a third run of the 
30 Kalman Filter (see Table 12). Similarly, as shown in Table 12, the elements in column 3 of Tables 10 and 
11, obtained following this third run of the Kalman Filter, indicate that two further elements, the change of 
turbine efficiency and the inlet temperature sensor bias, can be eliminated for a fourth run of the Kalman 
Filter. Further reiteration of the process leads to a single component performance change remaining for the 
sixth run. 

35 For each run an objective function is calculated, based on the six degrees of freedom of the system 
(the number of observed performance measurements being six). From chi-square tables with six degrees of 
freedom and an acceptable probability level of 95%, the maximum value of the objective function is 
determined as 12.6. In simple statistical terms, passes 1 and 4 might be considered the best answers 
because they give the lowest values for the objective function; however, applying the further condition that 

40 the answer should explain the performance changes in terms of the minimum number of component 
changes and sensor biasses, pass 4 of the Kalman Filter is selected as the "best answer". It will be noted 
that this result reproduces very closely the actual component changes and sensor biasses assumed at the 
outset. 

As discussed above, it is also possible to apply known techniques to a number of sets of performance 
45 measurement differences observed over a period of time to obtain smoothed values and estimate trends 
and deviations of observed values from predicted levels. The application of the Kalman Filter technique of 
concentrating the estimates of component performance changes and/or sensor biasses into a minimum 
number of such parameters, as described with reference to the preceding figures and tables, to the 
derivation of such level and trend estimates is ilustrated schematically in Fig. 4. This shows the 
50 measurement differences obtained from the engine of Fig. 3 being employed in the one instance (Block A) 
in the concentration process already described to give a "best answer" from an instantaneous set of data, 
and in the other instance (Block B) through the processing, by the known techniques, of a number of such 
sets of data collected at intervals to derive the levels and trends contained in that data. The data from Block 
B itself requires further analysis to produce an estimate of the levels and trends in the component changes 
55 and/or sensor baisses that underlie the measurement difference levels and trends produced in the process 
of Block B. For this purpose, the data output from Block B is input to a Kalman Filter in which a 
concentration process of the form already described is performed (Block C). 
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Fig. 4 indicates the different sets of data that may be derived in Block B, namely level estimates, trend 
estimates and differences (A) between observed and predicted values. Each set is subjected to analysis 
separately by a Kalman Filter with which the concentration technique is applied to give a final output which 
satisfactorily explains the data in terms of the least number of component performance changes and/or 
5 sensor biasses. 

Also indicated in Fig. 4 is the use of the basic (unconcentrated) output from the Kalman Filter (Block A) 
from a series of sets of measurement difference inputs to provide the data for the algorithms for smoothing 
and for deriving trends in the data (Block D), although generally processing in the manner shown in Blocks 
B and C will be preferred. 

70 As an example of the manner in which the foregoing analysis of levels and trends operates, there will 
now be described a case in which, in a series of 20 sets of measurement readings from a gas turbine, after 
the 8th set the compressor efficiency (DE25) begins to fall at the rate of 0.2% in each succeeding reading. 
With the same sensor sources of the earlier example of tables 8-12, the measurement differences for each 
of the data sets 1-20 provides the matrix shown in Table 13. 

75 By employing this matrix in the prior art, a table of level estimates for the measurement differences is 
produced (Table 14). When this data is processed by the Kalman Filter in the reiterative manner already 
described with reference to Tables 8-12, "best answers" for the smoothed values of changes in compressor 
efficiency appear as shown in Table 15. It will be seen that, because of smoothing, when the change of 
level first occurs it is not recorded because the smoothing process indicates a change too small to be 

20 noted. When it first appears in set 11, the actual change (-0.6) is underestimated but the true value is soon 
reached (set 15 onwards). 

A similar pattern emerges when the trend estimates (Table 16) are input to the Kalman Filter and by the 
reiterative process the results shown in Table 17 are produced, showing a close approach to the actual 
trend from measurement set 13 onwards. 
25 From the foregoing description, it will be clear that the methods disclosed can be applied to a wide 
range of apparatus and plant if required. In the gas turbine field another application lies in test bed 
calibration; thus by running a particular engine in different test beds in turn, the differences of sensor bias in 
the two test beds can be analysed using the method of the invention. 

30 
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TABLE 1 

COMPONENT EXCHANGE RATE TABLE 

5 



DE25 

CW25 

DE4 

CW4 

A8 

P3 

0.0510 

0.0240 

0.1380 

-0.9400 

0.4010 

T3 

-0.4240 

-0.1600 

0.2970 

-0.3820 

0.4120 

T7 

-0.9700 

-0.3630 

-0.8300 

0.3550 

-0.2390 

WFE 

-1.0190 

-0.3710 

-0.8650 

0.3770 

0.0870 

NH 

0.1010 

-0.5220 

0.5600 

-0.3170 

0.6470 

Wl A 

0.5280 

0.2060 

0.4580 

-0.1860 

0.4680 




TABLE 2 




ENVIRONMENTAL 

EXCHANGE 

RATE TABLE 




FNS 

P2S 

T2S 



P3 

-0.6100 

-0.4140 

0.0380 



T3 

-0.2920 

0.3520 

-0.9390 



T7 

-0.6780 

0.8360 

-0.9890 



WFE 

-1.3560 

0.5670 

-0.6460 



NH 

-0.3240 

0.4080 

-0.4600 



W1A 

-0.2840 

-0.7760 

0.5330 
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TABLE 6 

STANDARD DEVIATIONS FOR THE A-PRIORI COVARIANCE 
MATRIX OF COMPONENT CHANGES AND SENSOR BIASSES 


DE25 

0.89<f 

CW25 

0.950 

DE4 

0.962 

cw4 

0.642 

A8 

1.087 

FNS 

0.619 

P2S 

0.764 

T2S 

0.644 

P35 

0.568 

T35 

0.414 

175 

0.425 

WFES 

0.589 

W1AS 

0.426 


40 

Note: The covariance matrix is a diagonal matrix made 
up from the squares of the above values. 

45 


50 


55 
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TABLE 7 

KALMAN GAIN MATRIX ON FIRST PASS 



P3 

T3 

T7 

WFE 

NH 

W1A 

DE25 

-0.0244 

-0.4694 

0.0029 

-0.1541 

0.3774 

0.0555 

CW25 

0.0020 

0.5891 

-0.1336 

-0.0275 

-0.8070 

0.2112 

DE4 

-0.1849 

0.3103 

-0.2284 

-0.1501 

0.2518 

0.0027 

CW4 

-0.4512 

-0.1045 

0.0297 

0.1200 

0.0631 

0.2487 

A8 

-0.0143 

0.1009 

-0.0861 

0.1997 

0.4126 

0.3788 

FNS 

-0.1256 

0.1128 

-0.0884 

-0.2076 

-0.0566 

-0.2489 

P2S 

-0.1246 

-0.1394 

0.0329 

-0.0319 

0.4084 

-0.3576 

T2S 

0.0369 

-0.3847 

-0.1740 

0.1331 

0.0736 

-0.0036 

P35 

0.4711 

-0.1432 

0.0617 

-0.0844 

-0.0084 

-0.2272 

T35 

-0.0761 

0.4203 

-0.1019 

0.0125 

-0.2679 

0.0425 

T75 

0.0345 

-0.1074 

0.4657 

-0.2597 

0.0478 

0.2568 

WFES 

-0.0907 

0.0254 

-0.4989 

0.4556 

-0.0202 

-0.1308 

W1AS 

-0.1278 

0.0450 

0.2580 

-0.0684 

-0.0635 

0.4264 
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TABLE 8 

Measurement Differences (y) created by -1% compressor 

5 

efficiency, -0.5% thrust (power setting) bias and 
+0.5% turbine exit temperature bias 

10 

Compressor exit pressure change 
Compressor exit temperature change 

75 

Turbine exit temperature change 
Fuel flow change 
20 Shaft speed change 
Inlet airflow change 


(P3) +0.254% 

(T3) +0.570% 

(T7) +1.809% 

(WFE) +1.697% 

(NH) +0.061% 

(W1A) -0.386% 


30 


35 


40 


45 


50 


55 
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TABLE 9 

Analysis by Kalman Filter of above measurement changes 


(DE25) -0.528% + 
(CW25) -0.083% 
(DE4) -0.524% * 
-0.009% 
+0.116% 
-0.387% + 
+0.057% 
-0.293% * 


(CW4) 

(A8) 

(FNS) 

(P2S) 

(T2S) 


Compressor efficiency change 
Compressor flow capacity change 
Turbine efficiency change 
Turbine flow capacity change 
Propelling nozzle area change 
Thrust sensor bias 
Inlet pressure sensor bias 
Inlet temperature sensor bias 
Compressor exit pressure sensor 
bias 

Compressor exit temperature 
sensor bias 

Turbine exit temperature sensor 
bias 

Fuel flow sensor bias 
Inlet airflow sensor bias 
Notes 

1. Note underestimation of changes/biasses used to generate 
measurements (+), and estimation of spurious changes/biasses (significant 
values marked *) caused by "smearing". 

2. No shaft speed sensor bias is assumed to be present. 


(P3S) +0.094% 

(T3S) +0.024% 

(T7S) +0.253% + 

(WFES) -0.089% 
(W1AS) +0.175% * 
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TABLE 10 



Sequential estimates of component changes and 

sensor biasses 

Pass No. 

1 

2 3 4 

5 6 

DE25 

-0.528% 

-0.530% -0.573% -1.004% 

-1.061% -1.227% 

CW25 

-0.083% 

- - - 


DE4 

-0.524% 

-0.326% -0.288% 


CW4 

-0.009% 

- - - 


AS 

+0.116% 

- - - 


FNS 

-0.387% 

-0.502% -0.514% -0.487% 


P2S 

+0.057% 



T2S 

-0.293% 

-0.295% -0.250% 

- 

r Jb 

+0.094% 

- - - 


T3S 

+0.024% 



T7S 

+0.253% 

+0.388% +0.414% +0.488% 

+0.434% 

WFES 

-0.089% 



W1AS 

+0.175% 

+0.046% 


Objective 
Function 

0.021 

0.214 0.244 0.043 

27.932 69.811 


Value 
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TABLE 11 

Square roots of diagonals of P. matrix 


Pass No. 12 3 4 5 6 


DE25 0.68121 0.53285 0.52030 0.04418 0.04282 0.03405 

CW25 0.71771 ..... 

DE4 0.66073 0.35918 0.34459 

CW4 0.47459 - 

A8 0.75463 - 

FNS 0.44891 0.11166 0.10670 0.09352 

P2S 0.56342 - 

T2S 0.49342 0.32309 0.30037 

P3S 0.41307 ..... 

T3S 0.31521 ..... 

T7S 0.31066 0.13278 0.11353 0.06837 0.06759 

WFES 0.43457 ..... 

W1AS 0.32263 0.12175 .... 
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TABLE 12 

Absolute values of normalized estimates of component changes and sensor 
biasses, obtained by dividing the elements in Table 10 by the elements in Table 
11, and removing sign . 

Pass No. 1 2 3 4 3 6 


DE25 

0.775 


0.995 

1.101 

22.725 

24.778 36.035 

CW25 

0.116 

* 





DE* 

0.793 


0.908 

0.836 ♦ 



CW1 

0.019 

* 



- 

- 

A8 

0.15* 

* 

- 

- 

- 

- 

FNS 

0.862 


4.496 

4.817 

5.207 X 


P2S 

0.101 

* 





T2S 

0.594 


0.913 

0.832 + 



P3S 

0.228 

* 





T3S 

0.076 

* 





T7S 

0.81* 


2.922 

3.647 

7.138 

6.421 X 

WFES 

0.205 






WIAS 

0.5*2 


0.378 + 




Average 

0.*06 







Notes 

1. * denotes elements rejected because they are less than the average (pass 1 
only) 

2. + denotes elements rejected because they are less than the values in the 
previous pass 

3. X denotes elements rejected because they are the lowest values in the 
current pass. 
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TABLE 13 

MEASUREMENT DIFFERENCES FOR 20 SERIAL SETS OF READINGS 


30 


ET 

P3 

T3 

T7 

WFE 

NH 

Wi A 

1 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

2 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

3 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 


0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

5 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

6 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

7 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

8 

0.000 

0.000 

0.000 

0.000 

0.000 

0.000 

9 

-0.010 

0.085 

0.194 

0.204 

-0.020 

-0.106 

10 

-0.020 

0.170 

0.388 

0.408 

-0.040 

-0.211 

11 

-0.031 

0.254 

0.582 

0.611 

-0.061 

-0.317 

12 

-0.041 

0.339 

0.776 

0.815 

-0.081 

-0.422 

13 

-0.051 

0.424 

0.970 

1.019 

-0.101 

-0.528 

If 

-0.061 

0.509 

1.164 

1.223 

-0.121 

-0.634 

15 

-0.071 

0.594 

1.358 

1.427 

-0.141 

-0.739 

16 

-0.082 

0.678 

1.552 

1.630 

-0.162 

-0.845 

17 

-0.092 

0.763 

1.746 

1.834 

-0.182 

-0.950 

18 

-0.102 

0.848 

1.940 

2.038 

-0.202 

-1.056 

19 

-0.112 

0.933 

2.134 

2.242 

-0.222 

-1.162 

20 

-0.122 

1.018 

2.328 

2.446 

-0.242 

-1.267 


40 


45 


50 
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TABLE 14 

LEVEL ESTIMATES FOR THE MEASUREMENT DIFFERENCES 


5 


70 


75 


25 


30 


>ET 

P3 

73 

T7 

M/FP 

wrc 

Ntt 

Win 


0.000 

0.000 

o nnn 

n nnn 
u.uuu 

A AAA 

u.UUU 

A AAA 

U.UUU 

2 

0.000 

0.000 

0.000 

n nnn 

n nnn 

U.UUU 

n nnn 

U.UUU 


o.ooo 

0.000 

o nnn 

n nnn 

A. AAA 

U.UUU 

A AAA 
U.UUU 


0.000 

0.000 

0 000 

n nnn 

u.UUU 

A AAA 

U.UUU 

A AAA 
U.UUU 


0.000 

0.000 

0 oon 

n nnn 

U.UUU 

A AAA 
U.UUU 

A AAA 
U.UUU 


o.ooo 

0.000 

0 000 

n nnn 

U.UUU 

n nnn 

U.UUU 

A AAA 
U.UUU 

7 

0.000 

0.000 

0 000 

n nnn 

U.UUU 

n nnn 

U.UUU 

A AAA 
U.UUU 

9 

o 

0.000 

o.ooo 

0 OHO 

n nnn 

U.UUU 

A AAA 
U.UUU 

A AAA 
U.UUU 

9 

-0.006 

0.047 

u. l u / 

n 1 1 ^ 

U. 1 1 J 

A A 1 1 

-U.U i 1 

a n^9 

-U.U26 

1 0 

-0 015 

— U. *J 1 J 


n i 


A A^Q 

A 1 < 1 

-0. 1 53 

1 1 

1 i 


0 213 


U.J 1 j 

A A ^ 1 
-U.U J 1 


12 

-0.037 

0.310 

0.708 

U. f 

n n7h 

-U.U/ 4 

-U. J5o 

1 "7 
1 -> 

-U.U*r 7 

n ld£ 

A Q09 


-0.097 

-0.505 

u 

-0.060 

0.499 

1.143 

1.200 

-0.119 

-0.622 

15 

-0.071 

0.590 

1.350 

1.418 

-0.141 

-0.735 

16 

-0.082 

0.678 

1.552 

1.630 

-0.162 

-0.845 

17 

-0.092 

0.765 

1.749 

.1.838 

-0.182 

-0.952 

18 

-0.102 

0.S5C 

i.944 

2.042 

-0.202 

-1.058 

19 

-G.il 2 

0.934 

2.138 

2.246 

-0.223 

-1.164 

20 

-C.123 

1.019 

2.331 

2.448 

-0.243 

-1.269 


35 


40 


45 


50 
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TABLE 16 

TREND ESTIMATES FOR THE MEASUREMENT DIFFERENCES 

5 


ET 

P3 

T3 

T7 

WFE 

NH 

W1A 

1 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

2 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

3 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

5 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

6 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

7 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

S 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

0.0000 

9 

-0.0022 

0.0179 

0.00 10 

0.0031 

-0.0003 

-0.0223 

10 

-0.0008 

0.0001 

0.0917 

0.0963 

-0.0095 

-0.0099 

11 

-0.0071 

0.0590 

0.1360 

0.1029 

-0.0102 

-0.0700 

12 

-0.0088 

0.0735 

0.1680 

0.1765 

-0.0175 

-0.0915 

13 

-0.0099 

0.0821 

0.1879 

0.1973 

-0.0196 

-0.1023 

10 

-0.0100 

0.0866 

0.1980 

0.0280 

-0.0206 

-0.1078 

15 

-0.0106 

0.0882 

0.2017 

0.2119 

-0.0210 

-0.1098 

16 

-0.0106 

0.0882 

0.2017 

0.2119 

-0.0210 

-0.1098 

17 

-0.0105 

0.0875 

0.2001 

0.2102 

-0.0208 

-0.1089 

18 

-0.010* 

0.0866 

0.1981 

0.2081 

-0.0206 

-0.1078 

19 

-0.0103 

0.0858 

0.1963 

0.2062 

-0.0200 

-G.1069 

20 

-0.0103 

0.0853 

0.1950 

0.2009 

-0.0203 

-0.1062 


35 


40 


45 


50 
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Claims 

1. A method for processing data relating to the performance of an apparatus, the apparatus including a 
plurality of components whose individual performances affect the performance of the apparatus and a 
plurality of sensors for giving inputs to a performance measurement system, the inputs from the 
sensors being subject to biases which produce errors in the measured performance of the apparatus, 
the method involving determination of changes in component performance and magnitude of sensor 
biases from a series of performance measurements, the method comprising the steps of: 
a) defining a-priori information required by a Kalman filter, comprising 

i) a covariance matrix of component performance measurement changes and sensor biases, 

ii) a measurement non-repeatability covariance matrix, 

iii) a system matrix which provides relationships between observed performance measurement 
changes and sensor biases; 
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b) using the performance measurement system to obtain datum levels of the performance measure- 
ments from the apparatus; 

c) using the performance measurement system to obtain performance measurements from the 
apparatus; 

5 d) using data obtained in steps (b) and (c) to derive performance measurement differences from 

datum levels; 

e) using data obtained in steps (a) and (d) to derive a most likely set of component performance 
changes and sensor biases by employing a Kalman filter; the method being characterised by the 
further steps of 

10 f) evaluating an objective function giving a measure of the amount of unexplained performance 

measurement change and/or the amounts of component performance measurement change and 
sensor bias in the solution from (e), 

g) discarding one or more of the component performance changes and/or sensor biases, to leave 
one or more of said component changes and/or sensor biases for evaluation; 
75 h) repeating steps (e) to (g), if required, until the total number of component performance changes 

and sensor biases remaining is one; and 

i) considering sets of estimated component performance changes and sensor biases produced in 
each repeat of step (e), together with the corresponding objective function evaluated according to 
step (f), to identify as a best result that repeat of step (e) which has produced a minimum number of 
20 component performance changes and sensor biases that satisfactorily account for the calculated 

performance measurement differences. 

2. A method according to claim 1 , in which the objective function is evaluated by deriving the sum of the 
squares of the unexplained performance measurement changes, weighted according to the measure- 

25 ment non-repeatability covariance matrix. 

3. A method according to claim 1 or claim 2 in which the component performance changes and sensor 
biases are normalised by dividing individual estimated component performance changes and sensor 
biases by the square roots of the corresponding diagonal elements of an a-posteriori covariance matrix 

30 produced as output from the Kalman filter. 

4. A method according to any one of claims 1 to 3 wherein, in the best result identified in step (i), 
component performance changes and/or sensor biases whose values are less than a predetermined 
lower level are discarded. 

35 

5. A method according to any one of claims 1 to 4 in which an average absolute amount of normalised 
change is evaluated after a first repeat of step (e) and provides a datum for discarding component 
performance changes and/or sensor biases prior to a second such repeat. 

40 6. A method according to any one of claims 1 to 5 in which, at the end of the second and each further 
repeat of step (e), changes in the absolute amounts of normalised change relative to the preceding 
repeat are evaluated for each of the remaining component performance changes and/or sensor biases 
and provide datums for discarding component performance changes and/or sensor biases prior to the 
next repeat. 

45 

7. A method according to claim 6 wherein component performance changes and/or sensor biases are 
discarded if they are less then their corresponding values in said previous pass, subject to at least the 
greatest said change or bias being retained and at least the smallest being discarded. 

50 8. A method according to any one of claims 1 to 7 in which a-priori values for elements of the covariance 
matrix of the component performance changes and sensor biases are estimated and a product is 
formed with (i) a Kalman Gain Matrix of the Kalman filter and (ii) the System Matrix, to evaluate a 
measure of confusion of desired component performance changes and/or sensor biases with other 
changes and/or biases due to said estimates, and said estimates are adjusted to reduce the confusion 

55 indicated by said evaluation. 

9. A method according to any one of claims 1 to 8 in which a-priori information supplied to the Kalman 
filter includes a best estimate of the effects on the matrices of at least one anticipated component 
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performance change and/or sensor bias. 

10. A method according to any preceding claim, in which a plurality of sets of performance measurements 
are obtained at intervals and employed to determine levels and/or trends and/or variations from 

5 predicted values in component performance change and/or sensor bias. 

11. A method according to claim 10, in which said sets of performance measurements are analysed for 
said levels and/or trends, and the level values and/or the trend values and/or the differences between 
observed and predicted measurements that are obtained from said analysis are then subjected to 

w Kalman filter processing. 

12. A method according to claim 10, in which said sets of performance measurements are subjected to 
Kalman filter processing and the values obtained are then analysed for levels and/or trends and/or 
variations from predicted values of component performance change and/or sensor bias. 

75 

Patentanspruche 

1. Verfahren zur Verarbeitung von Daten, die sich auf den Betrieb einer Vorrichtung beziehen, die 
mehrere Komponenten aufweist, deren individuelles Betriebsverhalten den Betrieb der Vorrichtung 
20 beeinfluBt, und die mehrere Sensoren besitzt, urn einem BetriebsmeBsystem Eingange zu liefern, wobei 
die Eingange von den Sensoren Fehlern unterworfen sind, die Fehler in dem gemessenen Betriebsver- 
halten der Vorrichtung erzeugen, wobei das Verfahren Anderungen im Betriebsverhalten der Kompo- 
nenten und in der GroBe der Sensorfehler aus einer Reihe von Betriebsmessungen ableitet, wobei das 
Verfahren die folgenden Schritte umfaBt: 
25 a) es wird eine a-priori-lnformation definiert, die fur ein Kalman-Filter erforderlich ist und folgende 

Bestandteile aufweist: 

i) eine Kovarianz-Matrix von BetriebsmeBanderungen der Komponenten und Sensorfehler, 

ii) eine Messung einer nicht reproduzierbaren Kovarianz-Matrix, 

iii) eine System-Matrix, die eine Beziehung zwischen beobachteten Betriebsmessungsanderungen 
30 und Sensorfehlern liefert; 

b) es wird das BetriebsmeBsystem benutzt, urn Bezugswerte der Betriebsmessungen der Vorrich- 
tung zu erlangen; 

c) es wird das BetriebsmeBsystem benutzt, urn Betriebsmessungen von der Vorrichtung zu erhalten; 

d) es werden die Daten, die in den Schritten (b) und (c) erlangt wurden, benutzt, urn BetriebsmeBdif- 
35 ferenzen von den Bezugswerten abzuleiten; 

e) es werden die in den Schritten (a) und (d) erlangten Daten benutzt, urn eine hochstwahrscheinli- 
che Gruppe von Komponentenbetriebsanderungen und Sensorfehlern durch Benutzung eines Kal- 
man-Filters abzuleiten; 

wobei das Verfahren durch die folgenden Schritte gekennzeichnet ist: 
40 f) es wird eine objektive Funktion berechnet, die ein MaB der Werte unerklarter BetriebsmeBande- 

rungen und/oder der Werte von KomponentenbetriebsmeBanderungen und Sensorfehlern in der 
Losung aus (e) liefert; 

g) es wird eine oder es werden mehrere der Komponentenbetriebsanderungen und/oder Sensorfeh- 
ler ausgeschieden, urn eine oder mehrere der Komponentenanderungen und/oder Sensorfehler zur 

45 Berechnung zu belassen; 

h) es werden die Schritte (e) bis (g) erforderlichenfalls wiederholt, bis die Gesamtzahl von Kompo- 
nentenbetriebsanderungen und Sensorfehlern, die verbleiben, Eins wird; und 

i) es werden die Gruppen berechneter Komponentenbetriebsanderungen und Sensorfehler, die bei 
jeder Wiederholung des Schrittes (e) erzeugt werden, zusammen mit der entsprechenden objektiven 

so Funktion betrachtet, die gemaB dem Schritt (f) berechnet wurde, urn als bestes Ergebnis jene 

Wiederholung des Schrittes (e) zu identifizieren, die eine minimale Zahl von Komponentenbetriebs- 
anderungen und Sensorfehlern erzeugt hat, die in zufriedenstellender Weise zu den berechneten 
BetriebsmeBdifferenzen beitragen. 

55 2. Verfahren nach Anspruch 1, bei welchem die objektive Funktion dadurch berechnet wird, daB die 
Summe der Quadrate der unerklarten BetriebsmeBanderungen gebildet wird, gewichtet gemaB der 
Messung der nicht reproduzierbaren Kovarianz-Matrix. 
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3. Verfahren nach den Anspruchen 1 Oder 2, bei welchem die Komponentenbetriebsanderungen und 
Sensorfehler normalisiert werden, indem individuelle berechnete Komponentenbetriebsanderungen und 
Sensorfehler durch die Quadratwurzeln der entsprechenden Diagonaleiemente einer a-posteriori-Kovari- 
anz-Matrix geteilt werden, die am Ausgang des Kalman-Filters erzeugt wird. 

5 

4. Verfahren nach einem der Anspruche 1 bis 3, bei welchem in dem besten Ergebnis, welches wahrend 
des Schrittes (i) erzeugt wird, Komponentenbetriebsanderungen und/oder Sensorfehler, deren Werte 
kleiner sind als ein vorbestimmter niedriger Wert, ausgeschieden werden. 

70 5. Verfahren nach einem der Anspruche 1 bis 4, bei welchem ein Durchschnitts-Absolutwert der normali- 
sierten Anderung nach einer ersten Wiederholung des Schrittes (e) berechnet wird und ein Bezugswert 
gebildet wird, urn Komponentenbetriebsanderungen und/oder Sensorfehler auszuscheiden, bevor eine 
zweite derartige Wiederholung erfolgt. 

75 6. Verfahren nach einem der Anspruche 1 bis 5, bei welchem am Ende der zweiten und jeder weiteren 
Wiederholung des Schrittes (e) Anderungen in den Absolutwerten der normalisierten Anderung relativ 
zu der vorhergehenden Wiederholung fur jede der verbleibenden Komponentenbetriebsanderungen 
und/oder Sensorfehler berechnet und Bezugswerte gebildet werden, urn Komponentenbetriebsanderun- 
gen und/oder Sensorfehler auszuscheiden, bevor die nachste Wiederholung erfolgt. 

20 

7. Verfahren nach Anspruch 6, bei welchem Komponentenbetriebsanderungen und/oder Sensorfehler 
ausgeschieden werden, wenn sie kleiner sind als ihre entsprechenden Werte in dem vorherigen 
Durchlauf, wobei wenigstens die grofite Anderung oder der groGte Fehler aufrechterhalten wird und 
wenigstens die kleinsten Werte ausgeschieden werden. 

25 

8. Verfahren nach einem der Anspruche 1 bis 7, bei welchem a-priori-Werte fur Elemente der Kovarianz- 
Matrix der Komponentenbetriebsanderungen und Sensorfehler berechnet werden und ein Produkt 
erzeugt wird mit (i) einer Kalman-Verstarker-Matrix des Kalman-Filters und (ii) mit der System-Matrix, 
urn ein Mafi der Konfusion der gewunschten Komponentenbetriebsanderungen und/oder Sensorfehler 

30 mit anderen Anderungen und/oder Fehlern infolge der Abschatzungen zu berechnen, wobei diese 
Abschatzungen eingestellt werden, urn die Konfusion, die durch die Berechnung angezeigt wird, zu 
vermindern. 

9. Verfahren nach einem der Anspruche 1 bis 8, bei welchem eine a-priori-lnformation, die dem Kalman- 
35 Filter zugefiihrt wird, eine beste Berechnung der Wirkungen der Matrizen von wenigstens einer der 

vorausgesagten Komponentenbetriebsanderungen und/oder Sensorfehlern aufweist. 

10. Verfahren nach einem der vorhergehenden Anspruche, bei welchem mehrere Gruppen von Betriebs- 
messungen in Zeitintervallen erlangt und benutzt werden, urn Pegel und/oder Trends und/oder Ande- 

40 rungen der vorausgesagten Werte der Komponentenbetriebsanderung und/oder Sensorfehler zu be- 
stimmen. 

11. Verfahren nach Anspruch 10, bei welchem die Gruppen von Betriebsmessungen fur jene Pegel 
und/oder Trends analysiert werden und die sich aus der Analyse ergebenden Pegelwerte und/oder 

45 Trendwerte und/oder die Differenzen zwischen beobachteten und vorhergesagten Messungen dann 
einer Verarbeitung im Kalman-Filter unterworfen werden. 

12. Verfahren nach Anspruch 10, bei welchem die Gruppen von Betriebsmessungen einer Kalman-Filter- 
Verarbeitung unterworfen werden und die erlangten Werte dann im Hinblick auf Pegel und/oder Trends 

50 und/oder Anderungen von vorausgesagten Werten von Komponentenbetriebsanderungen und/oder 
Sensorfehlern analysiert werden. 

Revendications 

55 1. Procede pour traiter des donnees relatives a la performance d'un appareil, I'appareil comprenant une 
pluralite de composants dont les performances individuelles affectent la performance de I'appareil et 
une pluralite de capteurs pour fournir des entrees a un systeme de mesures de performance, les 
entrees des capteurs etant soumises a des biais qui produisent des erreurs dans la performance 
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mesuree de Tappareil, le procede comprenant de determiner des changements de perfomance des 
composants et d'amplitude des biais de capteurs a partir de series de mesures de performance, le 
procede comprenant les etapes de : 

a/ definir une information a priori necessaire pour un filtre de Kalman, comprenant : 
5 i) une matrice de covariance des changements de performance des composants et des biais de 

capteur, 

ii) une matrice de covariance de non-repetatibilit6 de mesure, 

iii) une matrice systeme qui fournit des relations entre des changements observes de mesure de 
performance et des biais de capteur ; 

70 b/ utiliser le systeme de mesure de performance pour obtenir des niveaux de reference des 

mesures de performance de I'appareil, 

c/ utiliser le systeme de mesure de performance pour obtenir des mesures de performance de 
I'appareil, 

61 utiliser les donnees obtenues dans les etapes b/ et c/ pour deduire des differences de mesure de 
75 performance a partir des niveaux de reference, 

ef utiliser les donnees obtenues dans les etapes a/ et 61 pour deduire un ensemble le plus probable 
de changements de performances des composants et de biais de capteur en employant un filtre 
Kalman, 

le procede etant caracterise par les etapes supplementaires de : 
20 V evaluer une fonction objective donnant une mesure de la valeur de changement de mesure de 

performance inexplique et/ou les valeurs de changement de mesure de performance des compo- 
sants et de biais de capteur dans la solution issue de e/, 

g/ eliminer un ou plusieurs des changements de performance des composants et/ou des biais de 
capteur, pour laisser un ou plusieurs desdits changements de composants et/ou biais de capteur 
25 pour evaluation, 

h/ repeter les etapes e/ a g/ si necessaire, jusqu'a ce que le nombre total restant de changements 
de performance des composants et de biais de capteur soit un ; et 

i/ considerer les ensembles de changements de performance des composants et de biais de capteur 
estimes, produits dans chaque repetition de I'etape e/, ainsi que !a fonction objective correspondante 
30 evaluee selon I'etape f/ pour identifier comme meilleur resultat la repetition de I'etape e/ qui a 

produit un nombre minimum de changements de performance des composants et de biais de 
capteur qui rend compte de fagon satisfaisante des differences de mesure de performances 
calculees. 

35 2. Procede selon la revendication 1 , dans lequel la fonction objective est evaluee en deduisant la somme 
des carres des changements de mesure de performance inexpliquee, ponderee selon la matrice de 
covariance de non-repetatibilite de mesure. 

3. Procede selon la revendication 1 ou la revendication 2, dans lequel les changements de performance 
40 des composants et les biais de capteurs sont normalises en divisant les changements de performance 
des composants et les biais de capteur individuels estimes par les racines carrees des elements 
diagonaux correspondants d'une matrice de covariance a posteriori produit comme sortie du filtre de 
Kalman. 

45 4. Procede selon Tune quelconque des revendications 1 a 3, dans lequel dans le meilleur resultat identifie 
dans I'etape i/, les changements de performance des composants et/ou les biais de capteur dont les 
valeurs sont inferieures a un niveau inferieur predetermine sont eliminees. 

5. Procede selon les revendications 1 a 4, dans lequel la valeur moyenne absolue de changements 
so normalisees est evaluee apres une premiere repetition de I'etape el et fournit une valeur de reference 

pour eliminer les changements de performance des composants et/ou les biais de capteur avant une 
telle seconde repetition. 

6. Procede selon les revendications 1 a 5, dans lequel a la fin de la seconde repetition et de chaque 
55 repetition ulterieure de I'etape e/, des changements dans les valeurs absolues de changements 

normalisees par rapport a la repetition precedente sont evaluees pour chacun des changements de 
performance des composants et/ou des biais de capteurs restant et foumissent des valeurs de 
reference pour eliminer des changements de performance des composants et/ou des biais de capteurs 
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avant la prochaine repetition. 

7. Procede seion la revendication 6, dans lequel des changements de performance des composants et/ou 
des biais de capteurs sont elimines si ils sont inferieurs a leurs valeurs correspondantes dans ledit 

5 precedent passage, sous reserve d'au moins le plus grand dudit changement ou biais qui est retenu et 
d'au moins le plus petit dudit changement ou biais qui est eliminS. 

8. Procede selon les revendications 1 h 7, dans lequel des valeurs a priori pour des elements de la 
matrice de covariance des changements de performance des composants et des biais de capteur sont 

w estimees et un produit est forme avec i) une Matrice Gain de Kalman du filtre de Kalman et ii) la 
Matrice Systeme, pour evaluer une mesure de confusion des changements de performance des 
composants et/ou des biais de capteur desires avec d'autres changements et/ou biais en raison 
desdites estimations et lesdites estimations sont ajustees pour reduire la confusion indiqu^e par ladite 
evaluation. 

75 

9. Procede selon les revendications 1 a 8, dans lequel une information a priori envoyee au filtre de 
Kalman comprend une stimulation optimum des effets sur les matrices d'au moins un changement de 
performance des composants et/ou un biais de capteur anticipe. 

20 10. Procede selon Tune quelconque des revendications precedentes, dans lequel une pluralite d'ensembies 
de mesures de perfomance sont obtenus a intervalles et employes pour determiner des niveaux et/ou 
des tendances et/ou des variations a partir de valeurs anticipees de changements de performance des 
composants et/ou de biais de capteur. 

25 11. Procede selon la revendication 10, dans lequel lesdits ensembles de mesures de performance sont 
analyses pour lesdits niveaux et/ou tendances, et les valeurs de niveau et/ou les valeurs de tendance 
et/ou les differences entre les mesures observees et anticipees qui sont obtenues a partir de ladite 
analyse sont ensuite soumises a un traitement par filtre de Kalman. 

30 12. Procede selon la revendication 10, dans lequel lesdits ensembles de mesure de performance sont 
soumis a un traitement par filtre de Kalman et les valeurs obtenues sont ensuite analysees pour des 
niveaux et/ou des tendances et/ou des variations a partir de valeurs anticipees de changements de 
performance des composants et/ou de biais de capteur. 

35 
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